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Abstract —This work is devoted to the analysis of the perfor¬ 
mance of energy detection based spectrum sensing in the presence 
of enriched fading conditions which are distinct for the large 
number of multipath components and the lack of a dominant 
components. This type of fading conditions are characterized 
efficiently by the well known Nakagami —q or Hoyt distribution 
and the proposed analysis is carried out in the context of the area 
under the receiver operating characteristics (ROC) curve (AUC). 
Unlike the widely used probability of detection metric, the AUC 
is a single metric and has been shown to be rather capable of 
evaluating the performance of a detector in applications relating 
to cognitive radio, radar systems and biomedical engineering, 
among others. Based on this, novel analytic expressions are 
derived for the average AUC and its complementary metric, 
average CAUC, for both integer and fractional values of the 
involved time-bandwidth product. The derived expressions have a 
tractable algebraic representation which renders them convenient 
to handle both analytically and numerically. Based on this, they 
are employed in analyzing the behavior of energy detection based 
spectrum sensing over enriched fading conditions for different 
severity scenarios, which demonstrates that the performance of 
energy detectors is, as expected, closely related to the value of 
the fading parameter q. 

I. Introduction 

The detection of unknown signals has been an important 
research topic over the past decades. This has been largely 
required in the context of radar systems and more recently in 
cognitive radio based communications which have attracted 
a significant interest by both academia and industry due 
to the prominent ability to increase the utilization of the 
currently scarce spectrum resources. The operational principle 
of detecting unknown signals is typically based on spectrum 
sensing (SS) with energy detection (ED) constituting the most 
simple and widely adopted method. The ED is based on the 
deployment of a radiometer, which is a non-coherent detection 
device that measures the energy level of a received signal 
waveform over an observation time window. The obtained 
measure is then compared to a pre-defined energy threshold 
and based on this it is determined whether an unknown signal 
is present or absent m-0. 


Detection of unknown signals over a flat band-limited Gaus¬ 
sian noise channel was firstly addressed in ED where analytic 
expressions were proposed for the probability of detection, 
Pd, and probability of false alarm, Pf, measures. These 
performance metrics are based on the statistical assumption 
that the decision statistics follow the central chi-square and 
the non-central chi-square distributions, respectively. A few 
decades later, this problem was revisited in 0, 0 assum¬ 
ing quasi-deterministic signals over fading channels. To this 
effect, numerous studies analyzed the performance of energy 
detectors under different communication and fading scenarios. 
Specifically, the authors in 0 derived closed-form expressions 
for the average probability of detection over Rayleigh, Rice 
and Nakagami —m fading channels for both single-channel 
and multi-channel scenarios. The ED performance in the case 
of equal gain combining over Nakagami— to multipath fading 
was reported in 0 while the performance in collaborative 
spectrum sensing and in relay-based cognitive radio networks 
was thoroughly investigated in m-m. In the same context, 
a semi-analytic method for analyzing the performance of en¬ 
ergy detection of unknown deterministic signals was reported 
in 021 and is based on the moment-generating function (MGF) 
method. This method was utilized in diversity methods in the 
presence of Rayleigh, Rice and Nakagami— to fading in fl5ll 
as well as for the useful case of correlated Rayleigh and Rician 
fading channels in fl6l . Finally, the detection of unknown 
signals in low signal-to-noise-ratio (SNR) over AT—distributed 
(K ), generalized I\ (Kg) as well as in generalized multipath 
fading channels was analyzed in iflTl - OTI . 

It is noted here that nearly all analyses and investiga¬ 
tions on the behavior of spectrum sensing techniques are 
based exclusively on the probability of detection and the 
probability of false alarm performance measures. However, 
another performance measure that is capable of evaluating 
adequately the performance of energy detectors exists, the so 
called area under the receiver operating characteristic curve 
(ROC). This performance measure is denoted as AUC and 


it has been widely used in several disciplines of sciences 
and engineering (32], lf33l and the reference therein. The 
distinct feature of this measure is that, contrary to Pd, it 
constitutes a single parameter measure and thus, it accounts 
for the overall performance of the detector in a more general 
manner. For example, the Pd measure is expressed as: i) a 
function of the instantaneous SNR, 7 , for the unfaded case 
or the average SNR, 7 , for the faded case with fixed values 
of Pf\ ii) a function of Pf with fixed values of 7 or 7 . 
Contrary to that, the AUC is expressed as a function of 7 
for the unfaded case or 7 for the faded case. Therefore, the 
AUC provides a more general insight on the overall behavior 
and performance of a detector as a function of 7 and 7 . Based 
on this, the authors in f34l - ll36l . (38], |39l addressed the AUC 
under different communication and fading scenarios. In more 
details, the authors in [[34j -f36] analyzed AUC in different 
diversity schemes and multipath fading channels. Likewise, 
investigation of AUC in amplify-and-forward relay scenarios 
were given in (38j while the complementary area under the 
ROC curve measure was proposed in lf39l . 

It is also widely known that the last decades witnessed 
numerous advances in wireless channel characterization and 
modeling. In this context, the Nakagami —q or Hoyt dis¬ 
tribution has been shown to be an accurate fading model 
for accounting for various multipath fading scenarios. The 
distinct feature of Hoyt fading model is that it is capable 
of accounting for enriched multipath fading conditions in the 
absence of any dominant component (371 . 140| - ||48] - and the 
references therein. Nevertheless, in spite of its usefulness it 
has not been explicitly considered in the context of energy 
detection. Motivated by this, the present work is devoted 
in analyzing the effect of Hoyt distributed multipath fading 
in the performance of energy detectors. To this end, novel 
analytic expressions are derived for the corresponding AUC 
and CAUC measures for both integer and fractional values of 
the involved time-bandwidth product. These expressions have 
a relatively simple algebraic representation which constitutes 
them relatively convenient to handle both analytically and 
numerically. With the aid of these expressions, it is shown that 
the performance of energy detection based spectrum sensing 
is rather sensitive at the severity of the fading conditions. This 
is particularly the case for moderate SNR values as even slight 
variations of q create an immediate effect on the value of AUC 
and CAUC. 

The remainder of this paper is organized as follows: The 
system and channel model are described in Section II. The 
area under the ROC curve and complementary area under 
the ROC curve of the energy detector over Hoyt fading 
channels are analyzed in Section III. Numerical results for 
various communication scenarios and discussions are provided 
in Section IV while closing remarks are given in Section V. 

II. System and Channel Model 
A. Energy Detection-Based Spectrum Sensing 

The received signal waveform in narrowband energy detec¬ 
tion follows the standard binary hypothesis lfl 6 l eq. ( 1 )] (and 


the references therein). 


r(f) = 


n(t) 

hs(t) + n(t ) 


■■H 0 
■ H, 


(1) 


where s(t) is an unknown deterministic signal and h, n(t ) 
denote the complex gain of the channel coefficient and an 
additive white Gaussian noise (AWGN) process, respectively. 
The samples of n(t) are assumed to be zero-mean Gaussian 
random variables with variance N 0 W with W and N 0 denot¬ 
ing the single-sided signal bandwidth and a single-sided noise 
power spectral density, respectively M- The hypothesis H 1 
refers to the case that an information signal is present whereas 
//ii refers to the case that an information signal is absent. The 
received signal is subsequently filtered, squared and integrated 
over the time interval T in ( 8 ] eq. (2)], namely. 
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r(t) | 2 dt. 


( 2 ) 


The output of the integrator is a measure of the energy of 
the received waveform which constitutes a test statistic that 
determines whether the received energy measure corresponds 
only to the energy of noise (Ho) °r to the energy of both the 
unknown deterministic signal and noise (Hi). By denoting 
the observation time bandwidth product as u = TW, the 
test statistic follows the central chi-square distribution with 
2 u degrees of freedom under the Hq hypothesis and the non 
central chi-square distribution with 2 u degrees of freedom 
under the Hi hypothesis To this effect, the corresponding 
probability density function (PDF) in the presence of AWGN 
is expressed according to ( 8 ] eq. (3)], namely, 
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where 7 = \h\ 2 E s /No is the corresponding instantaneous 
SNR, E s is the signal energy and T (.), /„ (.) denote the 
gamma function and the modified Bessel function of the first 
kind, respectively, ED-ED, EH. 

As already mentioned, an energy detector is largely charac¬ 
terized by a predefined energy threshold, A. This threshold is 
particularly critical in the decision process and is promptly 
associated to three measures that overall evaluate the per¬ 
formance of the detector: i) the probability of false alarm, 
Pf = Pr(y > A | Ho); ii) the probability of detection, 
Pd = Pr(y > A | Hi) and iii) the probability of missed 
detection, P m = 1 — Pd- The first two measures are deduced by 
integrating ([3} over the interval between the energy threshold 
to infinity, {A, 00 }, yielding ( 8 l , 


Pf = 


r M) 

T{u) 


(4) 


and 

Pd = Qu(V*Y>^) ( 5 ) 


where Q m {a,b) and F (.. .) denote the generalized 
Marcum —Q function and the upper incomplete gamma 
function, respectively Q, ED. 




B. AUC and CAUC Performance Metrics 

The area under the ROC curve is a single parameter measure 
that can be used to evaluate the overall performance of energy 
detectors and therefore of spectrum sensing in cognitive radio 
and radar systems. The AUC is defined as, 


where 7 is the average SNR and q denotes the Nakagami —q 
fading parameter, which is valid in the range 0 < g < 1 . 
Likewise, the CDF of the Hoyt model is given by |[44l eq. (9)] 


AUC = A{^) = f 1 Piii'y, X)dP f (X) 
J 0 


and can be equivalently expressed as follows, 
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For the case that P/(A) and Pd( 7 , A) follow the central chi- 
square and the non central chi-square distributions, respec¬ 
tively, the AUC can be expressed by lf34l eq. (9)], namely. 
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and the corresponding MGF is expressed as El eq. (2.12)], 
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where 


a F(a + n) 

= 1 h“ 


denotes the Pochhammer symbol B50| . In the same context, 
the complementary area under the ROC curve is given by, 

CAUC = A'( 7 ) = J° P m ( 7 , X)dP f (X). (9) 
Equation ® can be re-written as follows, 

J Pmh,X)dP f (\) = -j Pm{l,X)dPf{X) (10) 
which can be equivalently expressed as, 

f 1 [1 - P d ( 7 , A)] dPf (A) = ^ dP f (X)— f P d { 7 , X)dPf(X) 

° ° ° ( 11 ) 
Based on this and with the aid of © and 0, it follows that 
CAUC = 1 - AUC, i.e. 


in a simple form that involves only elementary function. 

III. AUC and CAUC over Hoyt Fading Channels 

A. AUC for the Special Case that u is a Real Positive Integer 

Theorem 1. For 7 £ R + , u £ N and 0 < q < 1, the 
following closed-form expression is valid for the AUC over 
Hoyt (Nakagami—q) fading channels, 


-j _ ^4 fl + u - 1 \ q 1+2i 2 i+1 ~ 

Hoyt “ l ~ i y(27g 2 + (i+g 2 ) 2 r +1 


1 -l-u-ji 


( 17 ) 




,4 A 2 


( 1 -g 4 ) 


[(1 + q 2 ) 2 + 2 g 2 7 ] 2 


where 


b) b\(a — b)\ 
denotes the binomial coefficient and 


A'( 7 ) = 1 - A{ 7 ). 
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A closed-form expression for CAUC for integer values of u 
is deduced by substituting © in (fl2l i yielding [39] eq. (7)], 
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It is recalled that © and (fl3l ) hold for integer values of u. 

C. The Hoyt (Nakagami—q) Fading Distribution 

As already mentioned, the Hoyt fading model has been 
shown to represent effectively the small-scale variations of 
an information signal in non-line-of-sight (NLOS) communi¬ 
cation scenarios. Physically, this fading model accounts for 
the case of enriched multipath fading with no presence of a 
dominant component. The PDF of the instantaneous SNR in 
Hoyt fading channels is given by m eq. (2.11)], namely, 

1 O 2 (l+g 2 ) 2 7 ( (\ — Q^) r v\ 

7 * 7 ( 7 ) = „ 1 e 4g2 ~ 7 0 ( „ 7 ) (14) 


is the Gauss hypergeometric function m- im . 

Proof: When u £ N, the AUC can be expressed according 
to ®. Importantly, it can be also expressed in terms of the 
generalized Laguerre polynomial, Iffx), as follows 


T u ( 7 ) 

4 ( 7 ) = 1 - E 44- 


1=0 


2 i+Mg 2 


( 20 ) 


2g7 


4<? 2 7 


As a result, the average AUC over fading channels can be 
expressed as, 
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where p 7 ( 7 ) denotes the SNR PDF of the fading statistics and 
Jo Pi ( 7)^7 = 1- F° r th e case of Hoyt fading channels, one 





























needs to substitute (IT4l) in ( 12 1 b . To this effect and by expanding 
L“(x) according to (53] eq. (8.970.1)] one obtains. 
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dy. 


Notably, the class of J 0 °° x a exp(— bx)Io{cx)dx integrals can 
be expressed in closed-form with the aid of ll53l eq. (6.621.1)] 
and lf53l eq. (8.406.3)]. Therefore, by performing the necessary 
change of variables and substituting in ( 122 b . equation (fT71 > is 
deduced, which completes the proof. ■ 


B. AUC for the Case that u is an Arbitrary Positive Real 

Theorem 2. For y, u £ R + and 0 < q < 1, the follow¬ 
ing closed-form expression is valid for the AUC over Hoyt 
(Nakagami—q) fading channels, 

■J _ q 1+2l ( 1 + q 2 ) 7 (l + u)u 2 F\ (1, l + 2u; 1 + it; \) 

Y u\2 2u ~ l ~ 1 (Ayq 2 + (1 + q' 2 ) 2 ) l+1 
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Proof: When the value of the time-bandwidth product is 
arbitrary real, the AUC can be expressed as follows (36), 


m = E 


7 ^ 


1 =0 


l\u\2 l+2u e't 


2 j 1, l + 2u\ 1 + w; - ) ■ (24) 


Thus, by averaging (1241 over the fading statistics in (fl4t yields. 
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The integral in (l25l > has the same algebraic form as the integral 
in d23. Therefore, by making the necessary change of vari¬ 
ables in ||53] eq. (6.621.1)] and l53l eq. (8.406.3)], substituting 
in (l25l l and carrying out some algebraic manipulations, one 
obtains (f23b thus, completing the proof. ■ 


C. CAUC for Positive Integer and Arbitrary Real Values of u 

As already mentioned, the CAUC is a complementary 
measure to the AUC. 
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Proof: Given that A’{ 7 ) = 1 — 21 ( 7 ), it follows that 
A !Hoyt = 1 — A'Hoyt- Based on this, the proof is immediately 
completed by substituting ( IT71 ) and ( l23b . ■ 

In the same context, an analytic expression can be derived 
for the case of arbitrary value of u. 


Corollary 2. For 7 , 0 < q < 1 and for the cases that u € 
R + , the following expressions hold for the CAUC over Hoyt 
(Nakagami—q) fading channels, 

— 1 (1 + q 2 ) 7 (/ + u) u 2 F 1 (l, l + 2 u] 1 + w, 

H ° yt_ ~P^o uW^-iq- 1 - 21 (47 q 2 + (1 + q 2 ) 2 ) l+1 

(27) 

tlL + i-i. __.) 

2 ’2 ’ ’ (Ayq 2 + (1 + q 2 ) 2 ) 2 J ' 

Proof: The proof follows immediately by Corollary 1. ■ 
To the best of the authors knowledge, equations (fTTb . (l23l) . 
(l26l > and (1271 have not been previously reported in the open 
technical literature. 


x 2 -Fl 


IV. Numerical Results 

Having derived new analytic expressions for the AUC and 
CAUC measures, this section is devoted to the analysis of 
the respective behaviour of energy detection-based spectrum 
sensing over Hoyt fading channels. The corresponding perfor¬ 
mance is evaluated for different communication scenarios by 
means of Anoyt vs 7 and A'noyt vs 7 curves. To this end. Fig. 



Fig. 1 . -^Hoyt vs 7 for i.i.d Hoyt (Nakagami— q) fading channels with 
u = 5 and different values of q. 


Corollary 1. For 7 , 0 < q < 1 and for the cases that u G 
N, the following expressions hold for the CAUC over Hoyt 
(Nakagami—q) fading channels , 
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1 demonstrates the average AUC as a function of the average 
SNR for u = 5 and different values of the Nakagami —q 
fading parameter. The special case q = 1, which corresponds 
to Rayleigh fading, is also depicted for comparison. Evidently, 
the performance of the detector is nearly excellent in the high 
SNR regime 7 > 25dB irrespective of the severity of fading. 
On the contrary, the overall performance is rather poor in the 



























Fig. 2. A'Hoyt vs 7 for i.i.d Hoyt (Nakagami— q) fading channels with 
u = 5 and different values of q. 

low SNR regime 7 < OdB, which indicates that the number of 
samples need to be increased. Regarding the moderate SNR 
levels, it is shown that the value of q affects the performance of 
the detector as, for example, the difference of A 1 [ oy t between 
q = 0.1 and q = 0.3 is 6% for 7 = lOdB and 5% for 
7 = 20dB. In the same context. Fig. 2 illustrates the behaviour 
of the complementary area under ROC as a function of the 
average SNR. As in Fig. 1, the overall performance of the 
behaviour increases as SNR increases while the effect of the 
value of q is rather noticeable for moderate SNR values. 
Indicatively, the difference of Anoyt between q = 0.1 and 
q = 1.0 is 80% for 7 = 15dB and 85% for 7 = 25dB. 

V. Conclusion 

This work analyzed the performance of energy detection 
over Hoyt (Nakagami— q) fading channels. This was carried 
out by means of the area under the ROC curve and the 
complementary area under the ROC curve metrics which 
are single parameter performance measures. Novel analytic 
expression were derived for the case of integer and arbitrary 
values of the time bandwidth product. These expressions 
have a relatively simple algebraic form which renders them 
convenient to handle both analytically and numerically. To 
this end, they were employed in quantifying the effect of 
enriched multipath fading conditions in energy detection based 
spectrum sensing in the context of cognitive radio and radar 
systems and it was shown that the corresponding severity 
of fading affects the detector’s performance, particularly for 
moderate SNR values. 
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